App B The Napkin Math: Predicting Token Speed from Memory Bandwidth
One formula tells you whether your hardware is working correctly or misconfigured. The community used this to diagnose the 40 t/s problem.
Posts tagged with "memory bandwidth"
Found 1 post